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Method and system for allocating shared resoiurces between applications 



This mvention relates to a method and a corresponding system of allocating 
si ittf resources between applications with media information on a resource limited 
platforai. Additionally, the invention relates to a computer-readable medium comprising a 
program, which may cause a computer to perform the method of the present invention. 



Real-time media processing is increasingly performed on programmable 
architectures due to their openness and flexibility. The drawback is that programmable 
components are more expensive compared with dedicated hardware and therefore the 

1 0 programmable components should be used in the most efficient way. One solution is to use 
scalable media algorithms in combination with dynamic resource management. These 
scalable algorithms provide resource scalability in exchange with output quaUty. Resources 
maybe CPU cycles, time, memory, bandwidth, co-processors, etc. 

On resource-limited platforms, a set of scalable and non-scalable algorithms 

1 5 may be running concurrently to enable an application like watching a movie, browsing 

through the Intemet, etc. As long as only one application is nmning, all available resources 
can be spent to ensure the highest possible quality for a given platform. The quality 
optimisation is part of the overall system control. After opening other ^plications in a 
second or more picture-in-picture window (PiP-window), the available resources must be 

20 shared, and a reoptimisation of the overall syst^ has to be performed, which again is part of 
the overall system control and not actively controllable by the user. 

EP 1 187 019 discloses a method of resolving conflicts in the allocation of a 
shared resource between applications. Resources referred to are hardware devices or 
hardware components such as display, sound system, memory devices, hard disk drive. EP 1 

25 187 019 relates to a so-called focus application, which is an application, with which the user 
is currently interacting, ia a multi-^plication environment. In case of conflicts, when a 
second application is accessing the same resoxirce (e.g. display, hard disk, sound system, 
memory devices), then the appUcation with user focus will get the resource, while the other 
application will be rejected. 
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However, EP 1 187 019 does not describe sharing of the same resources, like 
e.g. tiie display, for more than one application. In stead, all resotirces are granted to one 
application having user focus. 

Present dynamically adaptable systems do not automatically have information 
about user focus. It is a problem, that current user interfaces provide no means to inform the 
dynamically adaptable system about the user focus in a multi-application environment, and 
that the system therefore is unable to allocate resources to the different apphcations in a 
smart way. 



10 

Tliese problems are solved, when the method and corresponding system 
mentioned in the opening paragraph further comprises the following steps: identifying an 
application with a current focus of a user; setting the ou^ut quality of a new application to an 
appropriate high level, or increasing the output quality of an already ruxming application with 

IS the current focus of the user; automatically allocating (a) remaining part(s) of the resource(s) 
to at least one application without the current focus of the user. 

By performing the above steps, no user interaction is necessajry for quaUty 
optimisation in a system with more than one application running, where the best and adaptive 
distribution of the available resources is performed taking the user focus into accoimt. 

20 Throughout this description of the invention the term "resource" has a broader 

meaning compared to EP 1 187 019. In general terms, a resource is a device (e.g. display), 
component (e.g. CPU, memory, co-processor), or specification (e.g. bus bandwidth, time 
available) on which the resource management strategies described below can be 
implemented. One particular example of a resource is processor or microprocessor time. A 

25 resource can also be any software component which has a limitation on how oth^ 

components may access it and which can only process a limited number of applications at the 
same time. 

Throughout this description of the invention the term "active window" is 
meant to denote a part of a display related to an application, which is currentiy prioritised by 
30 a user. This appUcation is also denoted "application with cvurent focus of a user^' or "an 
application with user focus". Correspondingly, the term *^on-active window" is meant to 
describe a part of a display with an appUcation without current focus of a user. Finally, the 
term "opening an application/a window" is meant to cover the action of prioritising the 
specific apphcation/window, meanwhile the term "closing (down) an application/a window" 
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covers the action of giving the specific application/window a lower priority than one ore 
more other applications/windows or to end the use of the specific application/window. 

When the step of identifying the application with the current focus of the user 
is selected from at least one of the group of: user controlled, system controlled or externally 
controlled, the output quality of the application with user focus can be adapted automatically 
or manually. 

In an expedient embodiment, the user controlled step of identifying the 
application with the current focus comprises one or more of the following steps: selecting a 
new application as the application with the current focus of the user, when the new 
application is opened; changing the application with the current focus of the user to an 
application just switched to upon switching to an already opened application; when the user 
closes down an application with the current focus, switching to the application with the 
preceding focus of tiie user by keeping a record of the order of previously opened 
applications to indicate their importance in decreasing order, where the most recently opened 
application has the highest importance. This provides an advantageous way to identify which 
application is the application with the current focus of the user by way of predetermined 
settings, when a user interacts with the system. 

In another expedient embodiment, the system controlled step of identifying the 
application with the current focus of tiie user, is performed by one of the following steps: an 
automatically changing of the current focus of the user according to a predetermined priority 
hierarchy of the available applications; keeping a record of the order of previously opened 
applications to indicate their importance in decreasing order, where the most recently opened 
application has the highest importance and, switching to the application with the preceding 
focus of the user when the user closes down an ^plication with the current focus. Hereby 
there is provided an advantageous way for the system to identify which applications is the 
application with the current focus of the user by way of predetermined settmgs, with or 
without tiie \iser interacting with the system. This, of course, requires that the user hands over 
the control of which application is the application with user focus to tiie syst^ and that the 
system takes control rather than awaiting user control. 

When a provider of the media mformation performs the externally controlled 
identification of the application with the current focus of the user, extemal persons or 
systems are allowed to influence the relative importance of the various applications and 
thereby imposing a user focus on the most important application. An example could be that 
the relative importance of an application showing a commercial could be increased by 
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externally controlled identification of this application as the one with the current focus of the 
user. It would also be advantageous if an ^>pUcation with newscasts, either on teletext or as a 
television or radio broadcast, e.g. in the case of a radioactive leak, a nature catastrophe, etc., 
externally could be opened and/or given the highest priority, i.e. becouGong the application 
5 with the current focus of the user. 



with current focus of the user is performed automatically and with no additional input from 
the user, or manually changed (increased or decreased) by user interaction by means of a user 
interface, the allocation of the resources to the appUcations is performed in a user friendly 

10 way. Automatically changmg of the output quality of the application wifli the current focus of 
a user may work in many cases without additional inputs from a user, but in some cases the 
user may want to increase or decrease the output quality of the application with user focus 
manually. In the active window, which has the current focus of the user, this can be done by a 
user interface, such as a remote control. 

IS In a preferred embodiment of the invention the automatic settings of the 

overall system control is influenced by a learning frmction, which averages previous user 
settings of the past, so that the system can adapt to the preferences of one or more particular 
users. This has the advantage that the need for user interactions is decreased compared to a 
system without a learning function. The user preferences can vary over time, which also can 

20 be handled by the learning function. The learning ftinction can be implemented as a recursive 
fimction, a non-recursive (transversal) ftmction, a non-linear function, a function with 
different weightings, or any combination. The learning function can include a resetting 
mechanism, so that a user can cause the learning function to start over again with new 
settings from future choices by the user. 

25 Additionally, the invention relates to a computer-readable medium comprismg 

a program, which may cause a computer to perform the metiiod of the present uivention. A 
computer-readable medium may e.g. be a CD-ROM, a CD-R, a DVD RAM/ROM, a floppy 
disk, a hard disk, a smart card, a network accessible via a network coimection, a ROM, RAM, 
and/or Flash memory, etc. or generally any other kind of media that provides a computer 

30 system with information regarding how instructions/commands should be executed. Hereby, 
when a computer is caused to retrieve electronic information - as a consequence of the 
contents of a computer-readable mediirai as described above - the advantages mentioned in 
connection with the corresponding method according to the invention are achieved. 



When the step of setting or increasing the output quality of the application 
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The invention will be explained more fully below in connection with a 
preferred embodiment and with reference to the drawing, in which: 

Fig. 1 illustrates a flow diagram of an embodiment of the method according to 

the invention; 

Fig. 2 illustrates a schematic block diagram of components for controlling 

appUcations; 

Fig. 3 illustrates an alternative block diagram over components for controlling 
applications; and 

Fig. 4 illustrates a schematic block diagram of a system according to an 
embodiment of the present invention. 

Fig. 1 illustrates a flow diagram of an embodiment of the method according to 
the invention, wherein the flow starts in step 10 and continues to step 20. In step 20 the 
application with the current focus of a user is identified which can be user controlled, system 
controlled or externally controlled. 

The user controlled step of identifying the application with the current focus of 
the user, may comprise one or more of the following steps: selecting a new application as the 
appUcation with the current focus of the user, when the new application is opened; changing 
the appUcation with the current focus of the user to an appUcation just switched to upon 
switching to an already opened appUcation; when the user closes down an appUcation with 
the current focus> switching to the appUcation wifli the preceding focus of the user by keeping 
a record of the order of previously opened appUcations to indicate their importance in 
decreasing order, where the most recently opened appUcation has the highest importance. 

The System controUed step of identifying the appUcation with the current 
focus of the user, may be performed by one of the foUowing steps: an automatically changing 
of the current focus of the user according to a predetermined priority hierarchy of the 
available applications; keeprag a record of the order of previously opened appUcations to 
radicate their importance in decreasing order, where the most recentiy opened appUcation has - 
the highest importance and, switching to the appUcation with the preceding focus of the user 
when the user closes down an appUcation with the ciuxent focus. 

The extemally controlled step of identifying the appUcation with the current 
focus of the user may be performed by a provider of the media information. 
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When the application with the current focus of a user is identified, the process 
continues to step 30, wherein the ou^ut quality of the application with current focus of the 
user is set to an appropriate level in case of a new application, or changed in case of an 
aheady running application. This can be done automatically and with no additional input 

5 from the user, or manually by user interaction by means of a user interface. 

After setting or changing the quality of the appUcation with the current focus 
of the user, step 30, the process continues to step 40, wherem the remaining resources, 
depending on the resource needs of the application with current focus of a user, is allocated 
to s^pUcations, which are running in the background, i.e. without the current focus of a user. 

10 The remaining resources are distributed over appUcations in the background so that the total 
resource needs remain within the resource limit of the programmable platfomi. The overall 
system control should perform this allocation in an automated way. 

Of course, other tasks has to be performed, e.g. testing the feasibility of 
running all £^pUcations concurrently, running the ^^pUcations in the desired way, etc. In the 

1 5 case where all scalable applications are running witii their lowest resource use, another 

application might not be feasible, since in total more resources are required tiian available on 
the programmable platform. In the case, where all appUcations are running concurrently there 
might not be a possibility for further resource allocations to specific applications. Then it 
might be necessary to close down one or more applications or to put one or more applications 

20 on hold. In this description of the invention, it is presumed that all desired appUcations are 
feasible to run in paraUel and that sufficient resources can be allocated to the various 
appUcations. 

Fig. 2 iUustrates a schematic block diagram of components for controlling 
applications containing media information with or without the curr^it focus of a user on 

25 resource limited platforms in e.g. a PDA (personal digital assistant), a mobile telephone, at 
digital TV set, a personal computer, etc. An overall system control 30 is a software 
component, which is responsible for allocating available resources to different appUcations 
and monitoring their fimctionaUty. The system control 30 controls the relative importance of 
the various appUcations, which could be a television program, browsing through the Internet, 

30 a bi-directional videoconference, a baby phone, teletext, etc. As long as only one application 
is running, the system control aUocates all of the available resources to that particular 
appUcation to ensure the highest possible ou^ut quaUty. When a second appUcation is 
opened, the system control 140 has to reallocate the available resources depending on the 
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application with the current focus of the user, inputs from a user interface 110 and/or default 
settings 120. 

In some cases a user (not shown) may want to increase or decrease the output 
quality of an application manually. This can be performed by the user int^acting with the 

5 system control 140 by means of a user interface 1 10, such as a remote control, buttons, a 
'fx^ard, a keypad, a mouse, etc. It should be noted that these examples of user interfaces 
dti w only examples and are not in any way limiting the invention. Future user interfaces with 
e.g. voice control, eye movement control or even pointing with a finger could be user 
mierfaces within the scope of this invention. 

The default settings 120 are sets of programmed instructions for the software 
regarding which applications take priority above others. An example is an application with a 
baby phone running in the background and a movie running as the application with user 
focus. If the baby starts crying, a PiP-window with the baby phone application may pop up. 
The baby phone application becomes the application with the user focus and the soimd may 

1 S switch to the baby phone application. Hence, tiie system takes control of which application 
has the focus of the user without user interaction. 

Of course, the usct should be able to change the default settings 120 by means 
of the user interface 1 10. The combination of the default settings 120 and the user 
interactions by means of the user interface 110 results in parameter settings 150, which are 

20 sets of instractions for the software regarding which appHcation is to be the application with 
user focus imder various conditions. 

Fig. 3 illustrates an alternative block diagram over components for controlling 
applications and includes the measures shown in fig. 2 and described above. The same 
features are given the same reference numbers because of simplicity. Fig. 3 illustrates that the 

25 system control 140 is influenced by iiq>uts from the user interface 1 10, tiie default settings 
120, an external control 130 and a smart history memory 160. 

The external control 130 can e.g. be performed by means of a set-top box, 
which can be programmed to vary the perceived output quality of applications nmning in the 
system and/or to decide which applications should be the application with the current focus 

30 of the user. Hereby, a provider of television programs can influence the relative importance 
of applications, e.g. increasing the relative importance of an application associated with a 
commercial or news information making that particular application into the application with 
the current focus of a user. Of covirse, the system preferably could be programmed so that the 
user is able to override the external control. 
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A smart history memory 160 is a memory storing settings regarding e.g. the 
order of previously opened windows with s^plications, or preferred output qualities for the 
^plications input fix)m the system control 140. The smart history memory 160 also acts on 
the system control 140, for example by inputting information of the order of applications 
5 with previous user focus in the case, when an application is closed, so that the application 
with the previous user focus becomes the applications with the cxurent user focus. The smart 
history memory 160 can also store a learning function, which averages previous user settings 
of e.g. particular applications or combinations of applications of the past. 

The combination of the default settings 120, the user interactions by means of 

10 the user interface 110, and external control 130 input to the system control 140 results in 
parameter setthigs ISO as described above in relation to fig. 2 and optionally in an on screen 
display 170 of the quality setting for an s^plication with current user focus. The quality 
setting is preferably shown for a short time at e.g. a bar ranging from lowest to highest 
quality. Optionally, the quality settings of the applications without the cmxent focus of a user 

1 5 may be displayed as well. 

Figure 4 illustrates a schematic block diagram of an embodiment of a system 
according to the present invention. 

Shown is a system 300 according to the present invention comprising one or 
more micro-processors 301 connected with a memory/storage 302, co-processors 305, 

20 receiving means 303, a display 306 (optional), and one or more loudspeakers 306 (optional) 
via a conmiunications bus 304 or the like. The memory 302 has firmware, relevant software, 
rendering engine and/or program instructions, etc. The receiving means 303 is adapted to 
receive video/audio data and is for example a MPEG-decoder that can decode an MPEG 
stream received fix>m a data-broadcaster. The received data is stored in the memory means 

25 302 via the bus 304 for processing by the microprocessor means 301. The micro-processor(s) 
301 and co-processor(s) 305 (optional) is(are) responsible for deriving the display 
representation, which is sent to be displayed at the display 306 for presentation e.g. under the 
control of another/specialised processor directly responsible for generating the display 
presentation. 

30 Some applications only contain video/graphics information, such as teletext or 

games, others only audio information, and others again contain both video and audio 
information. The description given above of embodiments of the invention is intended to 
cover all these types of applications. 
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In some cases, it could be preferred that side-by-side windows (split screen) 
has equal importance, e.g. when to users are watching different contents. Audio information 
related to the applications in the windows can be distributed via headphones. In this case, the 
last opened window can be the window containing the application wifli current user focus. 
5 Through manual settings plus the learning function, the system can be programmed to 
understand the equal importance for this specific case. 

For easy representation of active and non-active windows, a Avindow frame 
can be marked by colours with optional different saturations. The active window can be 
selected by coloured buttons representing the wmdow colours on a remote control. The active 
1 0 window should automatically stay on top of other windows. The colour of the active window 
should indicate that this window has user focus, which can be done with higher saturated 
colours compared to the otiier windows. 

Thougji Ihe invention has been described with application(s) with current 
focus of a user, it is to be understood ttiat the metiiod works even if no user is present. 



